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TITLE OF THE INVENTION 



FOCUS DETECTING DEVICE 



BACKGROUND OF TH E INVENTION 



Field of the Invention 

The present invention relates to improvement of a focus 
detecting device for use in film cameras, digital color 
cameras and other cameras, and further to improvement of an 
image pickup (imaging) unit internally including the same 
focus detecting device. 
Description of the Related Art 

In digital color cameras , in response to depression of 
a release button, a solid-state image pickup element such as 
a CCD or a CMOS sensor is exposed to a field image for a 
desired period of time, and an image signal representative 
of a still image in one image plane is converted into a 
digital signal and is subjected to predetermined image 
signal processing such as YC processing to obtain an image 
signal of a predetermined format. 

The digital image signal indicative of the image picked 
up is recorded in a semiconductor memory according to frame 
image. The image signal recorded is, as occasion calls, 
read out to be displayed , or reproduced into a printable 
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signal and outputted to a monitor or the like to be 
displayed • 

In a case in which the image signal picked up is 
displayed as an image in the real time, the image signal can 
5 be displayed instead of being stored in the semiconductor 
memory f and it can be displayed as an image varying 
dynamically at all times. On the other hand, for the 

O 

■*Q display of a still image, the image signal is temporarily 

u * 

tQ stored in a semiconductor memory such as VRAM and is read 

03 

fylO out from that semiconductor memory to be displayed as a 
P still image in a monitor such as a liquid crystal display. 

|N Accordingly, in a case in which a plurality of still images 

R are taken and reproduced/displayed or printed afterwards, 

H the image signal is temporarily stored as a VRAM image 

a 15 signal in an erasable-type program ROM such as a flash 

memory or an EEPROM, a memory stick, a memory card or the 
like, with the VRAM image signal being stored 
semipermanently in a semiconductor memory, a memory tape or 
the like. 

20 However, in the case of a digital color camera offering 

a high-quality image, a need for more important factors 
exists at the image pickup. That is, as the factors, there 
are a focus detecting means at the image pickup and the lens 
alignment for placing the focus on a subject. 

25 C£) far / a digital color camera has employed a contrast 
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detection type focus detecting device. The contrast 
detection type obtains the sharpness of an object image , 
formed through an image pickup optical system, by evaluating 
an output of a/ solid-state image pickup element on the basis 
of a predetermined function for adjusting the position of 
the image pickup optical system on the optical axis so that 
the function/ value assumes an extremal value. Among the 
evaluation functions, for example, there are a function that 
adds the absolute value of the difference between the 
adjacent luminance signals in a focus detecting area, a 
function tpat adds the square of the difference between the 
adjacent luminance signals in a focus detecting area and a 
function that similarly processing the difference between 
the adjacent signals at the level of each of R, G and B 
image signals. 

In general, in such a contrast detection type focus 
detecting device, since the evaluation function is obtained 
while the position of the image pickup optical system on the 
optical axis is shifted bit by bit, the time for the 
evaluation function processing becomes necessary, and the 
focusing operation takes time until the in-focus condition 
is reached . 

In addition, as disclosed in USP4 , 410 , 804 , there has 
been known an image pickup unit incorporating the so-called 
phase difference detection type focus detecting device in 
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which one pair of or two pairs of light-receiving sections 
are provided according to two-dimensionally arranged 
microlens array to divide a pupil of an image pickup optical 
system by projecting the light-receiving sections on the 
pupil through the microlenses. The phase difference type 
forms object images through the use of two light beams 
passing through different portions of a pupil of an image 
pickup optical system for detecting the positional phase 
difference between the two object images on the basis of 
outputs of image pickup elements to convert the detected 
positional phase difference into a defocus quantity of the 
image pickup optical system. 

Since the phase difference detection type focus 
detecting device is capable of detecting the defocus 
quantity, it can considerably shorten the time taken until 
the in-focus condition is reached, as compared with the 
contrast detection type. 

A solid-state image pickup element with the structure 
disclosed in USP4 ,410,804 employs a microlens array to form 
one pair of or two pairs of images through the use of a 
light beam passing through a portion of a pupil of the image 
pickup optical system. The power of each microlens is set 
so the each of the light-receiving sections of the image 
pickup element is projected to an exit pupil of the image 
pickup optical system 24, while each light-receiving section 
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of the image pickup element and the exit pupil are in 
conjugate relation to each other. 

In this case, for establishing linear relationship 
between the light quantity incident on the light-receiving 
5 sections and the opening degree (aperture) of the diaphragm 
(iris) of the image pickup optical system, the projection" \ 
magnification may be selected so that a projected image on \ 

a \ 

tfi each light-receiving section is larger than the exit pupil 1 

m ■ . i 

fcjg at the release of the diaphragm of the image pickup opticalj 

03 

fy 10 system. Thus, knowing the subject luminance and the 

y, sensitivity of the image pickup element, the lens 

m (diaphragm) opening degree and the shutter speed are 

J?i calculable in the same manner as that for a film camera. 

r3 

i That is, the incident light quantity shows proportional 

w 15 relation to the opening area, which satisfies the 

calculation according to the APEX mode (Additive System of 
Photographic Exposure). 

However, the defocused condition creates a problem in 
that, since the configuration of the pupil divided is 
20 superimposed on a blurred image, difficulty is encountered 
in detecting a large-defocus condition. 

In addition, in this mode, as another factor to 
increase the detection error on the defocus quantity, there 
is an error resulting from manufacturing of the microlens. 
25 As mentioned above, the microlens projects a light-receiving 



- 6 - 



01 



E . I 



section to the exit pupil of the image pickup optical system. 
Assuming that the projection position is different according 
to pixel , the phase shift quantity at the defocus varies 
according to pixel. This provides a larger effect as the 
defocus quantity increases. However , the microlens has a 
very fine structure; therefore, in fact, the difference 
among the microlenses stemming from the manufacturing may be 
compromised to some degree. 



m 10 SUMMARY OF THE INVENTION 



Accordingly, it is a first object of the present 
invention to provide a phase difference detection type focus 
detecting device for use in an image pickup unit, which is 
15 constructed so that the incident light on an image pickup 

element is approximately proportional to an opening area of 
a diaphragm and which is capable of detecting a large 
defocus . 

A second object of the invention is to provide a phase 
20 difference detection type focus detecting device for use in 
an image pickup unit, which is capable of accepting a 
certain degree of error stemming from manufacturing of a 
microlens to be used in an photoelectric conversion element. 
In accordance with a feature of the invention, a focus 
25 detecting device for use in an image pickup optical unit 
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comprises first photoelectric conversion means for 
performing photoelectric conversion of a light beam emitted 
from a first pupil area of the image pickup optical unit, 
second photoelectric conversion means for performing 
photoelectric conversion of a light beam emitted from a 
second pupil area different from the first pupil area, light 
intercepting means having openings for allowing passage of a 
portion of light in the first pupil area and for allowing 

y3 passage of a portion of light in the second pupil area, and 

03 

fjj 10 detecting means for detecting a focus condition of the image 
y, pickup optical unit on the basis of photoelectric conversion 

outputs of the first photoelectric conversion means and the 
second photoelectric conversion means. 

The light intercepting means is detachable with respect 
15 to an optical path of the image pickup optical unit. 

In addition, the first photoelectric conversion means 
has a plurality of photoelectric conversion elements while 
the second photoelectric conversion means has photoelectric 
conversion elements each adjacent to each of the 
20 photoelectric conversion elements of the first photoelectric 
conversion means, with microlens means being located in 
front of said photoelectric conversion element of the first 
photoelectric conversion means and the photoelectric 
conversion element of the second photoelectric conversion 
25 means adjacent thereto. 



O 
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Still additionally , color filter means is placed in 
front of the photoelectric conversion elements. 

Moreover/ the light intercepting means is set in an 
optical path of the image pickup optical unit at the focus 
5 detection by the detecting means . 

Still moreover/ a signal processing circuit is provided 
_^ which produces an image signal by adding a photoelectric 

l O conversion signal from the first photoelectric conversion 

m 

4% means and a photoelectric conversion signal from the second 

m 

fij 10 photoelectric conversion means. 

Other features of the present invention will become 
y, more readily apparent from the following detailed 

yj description of the preferred embodiments taken in 

Q 

conjunction with the accompanying drawings. 

%»» 
n 

"~ 15 Further objects , features and advantages of the present 

invention will become apparent from the following 
description of the preferred embodiments ( with reference to 
the attached drawings ) . 

20 BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is an illustration of a construction of an image 

pickup optical system according to the present invention; 

Fig. 2 is a perspective view showing an image pickup 

25 unit according to the invention; 
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Fig. 3 is an illustration of a circuit arrangement of 
an area sensor section in an image pickup element according 
to the invention ; 

Fig- 4 is an illustration useful for explaining an 
5 image pickup area and a focus detecting area according to 
the invention; 

Fig. 5 is a cross-sectional view showing a light- 

□ 

yp receiving section according to the invention; 

U 1 

vfl Fig. 6 is a plan view showing location of pixels and 

fy 10 color filters according to the invention; 

Mi Fig. 7 is a plan view showing the positional 

5 

relationship between a microlens and a light-receiving 
j section according to the invention; 

Fig. 8 is an illustration of a surface condition of a 
15 microlens viewed from an oblique direction , according to the 
invention; 

Fig. 9 is a cross-sectional view showing an area sensor 
section according to the invention; 

Figs. 10A and 10B are illustrations of a light beam 
20 incident on a first photoelectric conversion section and a 
light beam incident on a second photoelectric conversion 
section; 

Fig. 11 is an illustration of a light beam incident on 
a second photoelectric conversion section, according to the 
25 invention; 



d 
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Fig. 12 is an illustration useful for explaining a 
state of division of an exit pupil according to the 
invention; 

Fig. 13 is an illustration useful for explaining a 
pitch of pixels according to the invention; 

Fig. 14 is an illustration of a response characteristic 
of an image pickup element according to the invention; 

Fig. 15 is a block diagram showing an internal 
arrangement of an image pickup element/ including peripheral 
circuits, according to the invention; 

ig. 16 us an illustration useful for explaining an 
Output pos it ion designating command according to the 
invention,; 

Figs. 17A to 17D are illustrations for describing an 
electronic shutter function; of these illustrations , Fig. 
17A is an illustration for describing a case in which pixels 
are read out in vertical line sequence , Fig. 17B is a timing 
chart in a case in which storage times are substantially 
equal to each other/ Fig. 17C is a timing chart in a case of 
shortening electric charge storage time f and Fig. 17D is a 
timing chart in a case in which a signal level of a second 
line is different from that of other lines; 

Fig. 18 is a timing chart in a case of independently 
reading out signals of first and second photoelectric 
conversion sections according to the invention; 
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Fig. 19 is a timing chart in a case of adding the 
signals of the first and second photoelectric conversion 
sections according to the invention; 

Fig. 2 0 is an enlarged view showing a focus detecting 
area according to the invention; 

Fig. 21 is an illustration of image signals from light- 
receiving sections equipped with green color filters in a 
pixel line according to the invention; 

y3 Fig. 22 is an illustration of image signals from light 

03 

ffj 10 receiving sections equipped with green color filters in a 

pixel line according to the invention; 
i^jl Fig. 23 is an illustration of image signals from light 

HI receiving sections equipped with red color filters in a 

pixel line according to the invention; 

CSS? 

^ 15 Fig. 24 is an illustration of image signals from light 

receiving sections equipped with blue color filters in a 
pixel line according to the invention; 

Fig. 25 is an illustration of image signals from light 
receiving sections equipped with green color filters in a 
20 pixel line according to the invention; 

Fig. 26 is an illustration of image signals from light 
receiving sections equipped with green color filters in a 
pixel line according to the invention; 

Fig. 27 is an illustration of image signals from light 
25 receiving sections equipped with red color filters in a 



pixel line according to the invention; 

Fig. 28 is an illustration of image signals from light- 
receiving sections equipped with blue color filters in a 
pixel line according to the invention; 

Fig. 29 is an illustration useful for describing a 
state of division of an exit pupil at detection of a large 
defocus according to the invention; 

Fig. 30 is a perspective view showing an image pickup 
unit according to a second embodiment of the invention; 

Fig. 31 is an illustration useful for describing a 
state of division of an exit pupil at detection of a large 
defocus according to the invention; and 

Fig. 32 is an illustration useful for describing a 
state of division of an exit pupil at detection of a large 
defocus according to the invention. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Embodiments of the present invention will be described 
hereinbelow with reference to the drawings . 
[First Embodiment] 

First of all, a description will be given hereinbelow 
of an image pickup optical system for use in a first 
embodiment of the invention. 

Fig. 1 is an illustration of a construction of an image 
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pickup optical system according to the invention , showing a 
zoom optical system of a digital color camera using a solid- 
state image pickup element. In this illustration, the left 
side shows a subject side while the right side illustrates 
5 an image plane side. 

In the illustration, the image pickup optical system, 
designated generally at reference numeral 24, is made up of 

^ a positive first group (grpl) comprising a negative lens 

gt 

tfl having lens surfaces rl and r2, a positive lens having lens 

fU 10 surfaces r3 and r4 and a positive lens having lens surfaces 
r5 and r6, a negative second group (grp2) comprising 

M> negative and positive lenses having lens surfaces r9, rlO 

Q 

Uj and rll, a diaphragm ST, a positive third group (grp3) 

□ 

q comprising a positive lens having lens surfaces rl2 and rl3, 

D 

15 and a fourth group (grp4) comprising negative and positive 
lenses having lens surfaces rl4, rl5 and rl6. Additionally, 
reference mark Fl represents an infrared (IR) cut filter, 
reference mark LPF denotes an optical low-pass filter, 
reference numeral 100 depicts an image pickup element having 

20 an image pickup plane in which image pickup elements are 

arranged two-dimensionally , and reference mark LI signifies 
an optical axis of the image pickup optical system 24. 

In addition, as indicated by arrows in Fig. 1, as the 
focal length varies from the wide-angle side to the 

25 telephoto side in accordance with a zooming operation, the 
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negative second group grp2 shifts to the image plane (100) 
side and the positive fourth group grp4 shifts to the 
subject side, with the negative second group grp2 and the 
positive fourth grp4 moving simultaneously in opposite 
> directions . 

The image pickup optical system 24 includes a lens 
drive mechanism (not shown) to move the negative second 
group grp2 in the optical-axis directions through the use of 
* a motor and a gear for focusing, thereby producing an in- 

FU 10 focus state of an object image on the image pickup element 

A ioo. 



m 



g. 2 is a perspective view showing the image pickup 
^Umit. ito the illustration, numeral 201 designates, of the 
Q image pioJcup optical system 24, a front lens group 

15 collectively representing the first group (grpl) and the 

second group* (grp2) existing on the object side with respect 
to the diaphragm ST, numeral 202 represents, of the image 
pickup optical\ system 24, a rear lens group collectively 
representing the^ third group (grp3), the fourth group (grp4) 
20 and the optical low-pass filter LPF existing on the image 
plane side with respect to the diaphragm ST, with a light 
beam passing througmthe aperture (opening) of the diaphragm 
ST forming an object image on the image pickup element 100. 
The diaphragm ST is ro^atable around an axis L2, and 
25 selectively takes four positions at an interval of 90 



degrees owing to a drivinc 



Additionally, the diaphracm ST has five apertures designated 



at reference numerals 204 
205 and 206 are for the in 
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force of a motor (not shown). 



to 208 , with the apertures 2 04, 
age pickup, while the apertures 
207 and 208 are for a larde-defocus detection. 

Secondly, a description will be taken hereinbelow of 
the image pickup element 100 according to the invention. 

The image pickup element 100 is a CMOS process 
compatible photoelectric conversion sensor (which will be 
referred to hereinafter as a "CMOS sensor"). This type of 
sensor has been published in the documents such as "IEEE 
TRANSACTIONS OF ELECTRON DEVICE, VOL41, PP452-453, 1994". 

One feature of the CMOS sensor is a considerable 
decrease in the numbers of masks and processes in comparison 
with the case of a CCD, because MOS transistors for light- 
receiving sections and MOS transistors for peripheral 
circuits such as vertical /horizontal scanning circuits, 
shading correction circuit, a clamp circuit, an A/D 
converter and a signal processing circuit can be formed in 
the same process. 

?he present invention makes use of this feature, and 
6p photoelectric conversion sections are made in one pixel 
and, unlaSke a conventional art in which a floating diffusion 
area (which, will be referred to hereinafter as an "FD area) 
and a sourceXf ollower amplifier are provided according to 
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20 



photoelectric conver s ior 



follower amplifier are iormed with respect to two 



photoelectric convers ior 
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section, one FD area and one source 



sections, with two photoelectric 




25 



conversion areas being connected through a transfer MOS 
transistor switch to thct FD area. 

Accordingly, the electric charge in the two 
photoelectric conversion sections can be transferred 
simultaneously or separately to an floating diffusion 
section, and it is possible to simply add or non-add the 

of the two photoelectric conversion 
the timing of the transfer MOSS 
^f this arrangement enables the 
Lrst output mode in which a 
ion output is made using a light beam 
pupil of an image pickup optical system 
and a second output iAode in which an photoelectric 
conversion is made using a light beam from a portion of an 
exit pupil of an imajje pickup lens. In the first output 
mode in which the addition is made in terms of pixel, a 

r 

less-noise signal is obtainable as compared with a mode in 
which the addition it made after the readout of a signal. 

Fig. 3 is an illustration of a circuit arrangement of 
an area sensor section in the image pickup element 100. 
Although this illustration shows a two-dimensional area 
sensor of two columns x two rows, in fact, as shown in Fig. 



signal electric charge 
sections according to 
transistor. The use q 
switching between a f 
photoelectric convers 
from the entire exit 



4, the number of pixels is increased such that, for example, 
1920 columns x 1080 rows, thus providing a practical 
resolution. Incidentally, reference numerals 61 to 67 in 
Fig. 4 signify focus detecting areas which will be described 
later. The focus detecting areas are arranged vertically to 
easily understand a luminance distribution within an 
vertically elongated object such as a person in a subject. 
Fig. 3, reference numerals 1 and 51 denote 
otodidde-like first and second photoelectric conversion 
sections each comprising a MOS transistor gate and a 
depletion layer under the gate, numeral 2 and 52 depict 
photogates incLLcated by a symbol of a capacitor in the 
illustration, numeral 3 and 53 represent transfer switch MOS 
transistors for transferring the electric charge due to the 
photoelectric conversion of the first and second 
photoelectric conversion sections 1 and 51, numeral 4 
designates a reset MOSV transistor for resetting the electric 
charge of a floating diffusion section FD, numeral 5 
signifies a source follower amplifier MOS transistor for 
converting the electric charge in the floating diffusion 
section FD into a voltage in\a source follower mode for 
amplification, numeral 6 means\a vertical selection switch 
MOS transistor for selecting pixels in accordance with a 
pulse <(>S0 from a horizontal scanning section 16, numeral 7 
indicates a load MOS transistor constituting a load of the 
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source follower amplifier MOS transistor 5 for the 



amplification in the source 
a dark output transfer MOS 



follower mode, numeral 8 denotes 
transistor for transferring dark 
electric charge of the floating diffusion section FD, 
numeral 9 depicts a light output transfer MOS transistor for 
transferring, as a light output, the accumulated electric 
charge of the floating diffusion section FD at the image 
pickup, numeral 10 designates a dark output accumulation 
capacitor C TN for accumulating (storing) the dark output when 
the dark output transfer MoL transistor 8 turns on, numeral 



11 represents a light outpu 



accumulating the dark output. 



MOS transistor 9 turns on, numerals 12 and 54 indicate 
vertical transfer MOS transistors which turn on/off in 



accumulation capacitor C TS for 
when the light output transfer 



15 accordance with a control puJ.se from a vertical scanning 

section 15, numerals 13 and 55 indicate vertical output line 
reset MOS transistors for resetting a vertical output line, 
numeral 14 denotes a dif f erefntial output amplifier for 
outputting a difference between a light output and a dark 
20 output, numeral 15 designates a vertical scanning section 

for outputting a pulse for controlling the vertical transfer 

nd numeral 16 denotes a 
for outputting a reset pulse, a 



MOS transistors 12 and 54, c 
horizontal scanning section 



trigger pulse, a selection pulse and a transfer pulse for 
reading out the electric chc rge of the first and second 
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photoelectric conversion septions 1 and 51. 

Fig. 5 is a cross-sectional view showing a structure of 
a light-receiving section (for example, 30-11 in Fig. 3). 
The other light-receiving sections (for example, 30-21, 3 0- 
12, 30-22) have the same structure. 

In Fig. 5, reference numeral 17 represents a P-type 
well, numerals 18 and 58 designate gate oxide films, 

J3 numerals 19 and 59 depict first-layer poly-Si, numerals 20 

01 

m and 50 denote second-layer poly-Si, and numeral 21 indicates 

rfi 

fll 10 an n + floating diffusion area. The same parts as those in 

-{r& Fig. 3 are marked with the same reference numerals. For 

w 

tA example, the same parts are the first and second 



iVj photoelectric conversion sections 1 and 51, the photogates 2 

Q 

~S and 52, the reset MOS transistor 4, the source follower 

**** 15 amplifier MOS transistor 5, the vertical selection switch 
MOS transistor 6 and the load MOS transistor 7. 

The FD area 21 is connected through the transfer MOS 
transistors 3 and 53 to the first photoelectric conversion 
section 1 and the second photoelectric conversion section 51. 
20 In Fig. 5, although the first photoelectric conversion 

section 1 and the second photoelectric conversion section 51 
are shown in a state separated from each other, the boundary 
portion therebetween is extremely small in fact, and in 
practical use, the first photoelectric conversion section 1 
25 and the second photoelectric conversion section 51 can be 
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considered to be brought into contact with each other* The 
first photoelectric conversion section 1 and the second 
photoelectric conversion section 51 will hereinafter be 
referred to collectively as a "light-receiving section". 

Furthermore, numeral 22 represents a color filter for 
allowing the passage of light in a specified wavelength 
region, numeral 23 designates a microlens for efficiently 
leading a light beam from the image pickup optical system 24 
to the first and second photoelectric conversion sections. 

Fig. 6 is a plan view showing a layout of pixels and 
color filters. In the illustration, only a layout of four 
rows x four columns is shown partially. The pixels each 
including a light-receiving section and a MOS transistor are 
substantially laid out into a square, and are latticed in a 
state adjacent to each other. The light-receiving sections 
30-21, 30-22, 30-11 and 30-12 described above with reference 
to Fig. 3 are located in the pixels 70-11, 70-21, 70-12 and 
70-22 and, in Fig- 6, are expressed as area sensors 72-11, 
72-21, 72-12 and 72-22. Additionally, each pixel 70 
includes the light-receiving section 30, the reset MOS 
transistor 4, the source follower amplifier MOS transistor 5 
and the vertical selection switch MOS transistor 6. 

[j\ the pixels, the area sensor sections 7 2 are arranged 
to form\£he so-called Bayer pattern in which four pixels 
constitute one set, with R (read), G (green) and B (blue) 



color filters 22 being alternately located and a microlens 
23 being placed on each of the color filters 22. In the 
Bayer pattern, more G pixels the viewer is greatly sensitive 
to when viewing an image are placed than R or B pixels to 
wholly enhance the visual Image performance. In general, 
with an image pickup elemeiit in this mode, luminance signals 
are generated from the G pixels while color signals are 
produced from the R, G and IB pixels. 

As mentioned above, one pixel has two photoelectric 
conversion sections. In Fig. 6, characters R, G and B 
denote the photoelectric conversion sections with red, green 
and blue color filters, respectively, while numerals 1 and 2 
subsequent to R, G and B depict the first photoelectric 
conversion section and the second photoelectric conversion 
section, respectively. For example, Rl represents the first 
photoelectric conversion with the red color filter, while G2 
signifies the second photoelectric conversion section with 
the green color filter. 

Furthermore, in each pixel, the light-receiving section 
contributes approximately several tens percents, and the so- 
called aperture reaches approximately several tens percents . 
Thus, for effectively utilizing a light beam emitted from 
the image pickup optical system 24, there is a need to use a 
condensing lens for each of the light-receiving sections for 
deflecting light, directed to other than the light-receiving 



section, to the light-receiving section. 

^xfeig. 7 is a plan view showing the positional 
relationship between microlenses placed in front of the 
image pickup element and the light-receiving sections. Each 
of the mjwsrolenses 71-11 to 71-44 is an axisymmetic 
spherical u ens or aspherical lens in which its optical axis 
coincides approximately with the center of the corresponding 
light-receivdng section, and they have a rectangular 
effective portion and are arranged closely into a lattice- 
like configuration in a state where their light incidence 
sides form a convex. Fig. 8 is an illustration of a surface 
state of the microlenses viewed from an oblique direction. 
Each of the microlenses is formed with respect to a pair of 
first and second photoelectric conversion sections, and they 
are formed into an X-Y matrix configuration to efficiently 
condense light for comAerge a subject image. 

Secondly, a detailed description will be given 
hereinbelow of a function of the microlens . 

Fig. 9 is a cross-sectional view showing an area sensor 
section. The image pickup optical system 24 stands on the 
left side in the illustration, and a light beam emitted from 
the image pickup optical system 24 passes through the IR cut 
filter Fl and the optical low-pass filter LPF to reach the 
microlenses 71-11, 71-21, 71-31 and 71-41. The color 
filters 22G, 22R, 22G and 22R are placed at the rear of the 
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microlenses 71-11, 71-21 f 71-31 and 71-41, respectively, to 
select only desired wavelength regions, and the light beam 
then reaches the light-receiving sections 72-11 to 72-41. 
The color filters 22 of three types R, G and R are disposed 
5 to form the Bayer pattern as described above with reference 
to Fig. 6. Additionally, because of the Bayer pattern, of 
these color filters 22, two types appear in a cross section. 
The color filter 22G is a green transmission color filter, 
while the color filter 22R is a red transmission color 
10 filter. Still additionally, in other cross sections in row 
or column directions, a green transmission color filter 
exists as the color filter 2 2G while a blue transmission 
color filter exists as the color filter 22B. 

/5he power, i.e., magnification, of each microlens is 
15 r( sret to renable the projection from each of the light - 

/ receiving sections of the image pickup element to the exit 
* pupil of \he image pickup optical system 24. At this time, 
the projection magnification is set so that the projected 
image of the \ight-receiving section becomes larger than the 
20 exit pupil at the release of the diaphragm ST of the image 
pickup optical system 24, while the light quantity incident 
on the light-receivd.ng section and the opening degree of the 
diaphragm ST of the image pickup optical system 24 are set 
to show a linear relationship. Thus, knowing the subject 
25 luminance and the sensitWity of the image pickup element, 
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the film camera/ which 
pickup operation. Thus 
focus detecting device 
be provided which faci] 
the APEX mode, shortens 



25 



the diagram opening and /the shutter speed are calculable in 
the same manner as that /for a film camera. That is, the 
incident light quantity/ becomes proportional to the 
diaphragm opening area jbo satisfy the calculation according 
to the APEX mode. Additionally, it is possible to calculate 
the exposure through the use of a common exposure meter like 

extremely facilitates the image 
r a phase difference detection type 
for use in an image pickup unit can 
itates the calculation according to 
the arithmetic processing time, and 
further offers the following effects. 

Furthermore, since a light beam for the focus detection 
varies according to the opening of the diaphragm ST, the 
image pickup light beam and the focus detection light beam 
coincide with each other at all times, and the in-focus 
detection result agrees well with the actual best resolution 
position of the image pickup optical system at the level of 
aberration. When an object image formed through the image 
pickup optical system 24 lies on a microlens, the image to 
be obtained by the image pickup element 10 0 takes the 
sharpest condition. 

Although the image pickup optical system 24 is 
preferably of a telecentric type whereby the incidence angle 
of the main light beam on the image pickup element becomes 
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zero because a high pupil projection accuracy is obtainable 
through the microlens, difficulty can be experienced in 
employing a complete telecentric type because of the 
requirements for size reduction and high zoom magnification* 
5 In this case, the centers of the microlens and the light- 
receiving section are made to be shifted slightly from each 
other and this decentering quantity is treated as a function 

yE3 of a distance from the optical axis of the image pickup 

Cm 

go optical system and the light-receiving section. In general, 

m 

ffj 10 if the shifting quantity is monotonously increased in 
y, accordance with the distance, even the light-receiving 

section around the image plane can correctly be projected 

eg 

yj onto the exit pupil of the image pickup optical system 24. 

S Figs. 10A and 10B separately show a light beam incident 

^ 15 on the first photoelectric conversion section and a light 

beam incident on the second photoelectric conversion section 
in the light-receiving section 72-11 in Fig- 9 for an easy 
understanding of the effect of the microlens providing a 
focus detecting function. In Figs. 10A and 10B, the 
20 microlens 71-11 is the same as the color filter 22G, and the 
first photoelectric conversion section Gl and the second 
photoelectric , conversion section G2 are shown. In Fig. 10A 
showing the light beam incident on the first photoelectric 
conversion section, the light beam is incident on the first 
25 photoelectric conversion section Gl from a lower side of the 
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illustration , while in Fig. 10B showing the light beam 
incident on the second photoelectric conversion section G2, 
the light beam is incident on the second photoelectric 
conversion section G2 from an upper side of the illustration. 
5 Accordingly, in the entire image pickup element , the 

light beam incident on the second photoelectric conversion 
G2 becomes as shown in Fig. 11. The light beam incident on 

03 any position of the area sensor section 100 forms a light 

01 

*B beam passing through the upper half of the diaphragm ST. On 

-33 

flj 10 the other hand, in the entire image pickup element of the 

=** 

■SSK 

area sensor section 100, the light beam incident on the 

1^ first photoelectric conversion section can be considered to 

Q 

yj be a light beam inverted vertically around the optical axis 

Jsf Ll of the image pickup lens serving as a symmetry axis. 

^ 15 That is, the state of division of the exit pupil is as shown 
in Fig. 12. In the illustration, reference numeral 210 
represents an exit pupil of the image pickup optical system 
24 when the diaphragm ST is in the open condition 204 shown 
in Fig. 2, and it is a virtual image appearing when the 
20 opening 204 of the diaphragm ST is viewed through the rear 
lens group 202. Furthermore, in a lower side of the 
illustration, numeral 211 denotes a first area on the exit 
pupil through which the light beam incident on the first 
photoelectric conversion section of the image pickup element 
25 100 passes, while numeral 212 depicts a second area on the 



exit pupil through which the light beam incident on the 
second photoelectric conversion section of the image pickup 
element 100 passes. 

In addition, references 215 and 216 designate the exit 
pupil when the diaphragm ST is in a closing condition, and 
are virtual images appearing when the openings 205 and 206 
of the diaphragm ST are viewed through the rear lens group 
202. When the diaphragm ST takes the closing condition, as 
shown in the case of the openings 207 and 208, the first 
area 211 and the second area 212 becomes smaller in 
accordance with the closing condition thereof, and both the 
image signal obtained from the first photoelectric 
conversion and image signal obtained from the second 
photoelectric conversion section are formed by half of the 
light beam in a case in which the exit pupil of the image 
pickup optical system 24 is substantially divided into two. 

In the above-mentioned optical system, for example, in 
a case in which an object image is brought into focus in 
front of the image pickup element 100, a half of the light 
beam passing through the upper side of the exit pupil is 
shifted downwardly on the image pickup element 100, while 
another half of the light beam passing through the lower 
side of the exit pupil is shifted upwardly. That is, a pair 
of image signals formed by the light beams respectively 
passing through the first and second halves of the pupil of 
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the image pickup optical system 24 take conditions in which 
their phases are shifted in the vertical directions in Figs . 
6, 7 and 9 in accordance with the focusing condition of the 
object image. 

In a case in which image information is obtained 
through the use of an image pickup element , with respect to 
a high-frequency component of a spatial luminance 
distribution on an object, a noise image called "turning 
noise", having a low frequency different from that frequency, 
FU 10 appears due to the discrete image sampling. In a digital 

-M> color camera, this is the so-called "color breakup". 

p 

w& Additionally, in a case of performing the focus detection in 

O 

yj the phase difference detection mode by using an output of an 

p image pickup element, the "turning noise" makes it difficult 

Q 

15 for the phase information on an object image to correctly 

reflect the image output, which lowers the defocus detection 
accuracy. 

When the pitch of the pixels of the image pickup 
element 100 to be used in this case is taken as P, as shown 

20 in Fig. 13, the pitch of the pixels equipped with a green 
transmission color filter (G) is 2P in the vertical and 
horizontal directions and root 2P in diagonal directions, 
while the pitch of the pixels equipped with a blue 
transmission color filter (B) and the pitch of the pixels 

25 equipped with a red transmission color filter (R) are 2P in 
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the vertical and horizontal directions and 2 root 2p in the 
diagonal directions. Additionally , each of the pitches of 
the G pixels , the B pixels and the R pixels in the vertical 
directions for the focus detection is 2P. 

Assuming that the pitch P = 0.01 mm and regarding the 
vertical and horizontal directions , the Nyquist frequency vn 
is vn = 1/(2 x 2P) =25. On the other hand, the response 
characteristic of the image pickup element 100 on R, G and B 

03 is as shown in Fig. 14. In this illustration, the 

03 

flj 10 horizontal axis represents spatial frequency (number /mm) 

while the vertical axis denotes response, and the rise of 
y, the response on the high-frequency side exceeding the 

Nyquist frequency signifies the "turning noise". 

For eliminating such a problem, there is a need to 
15 prevent a high-frequency component of an object from 

reaching an image pickup element at the level of optical 
images. For suppressing the occurrence of the "turning 
noise" , an optical low-pass filter LPF made from a quartz is 
interposed between the image pickup optical system 24 and 
20 the image pickup element 100 and the characteristic of the 
optical low-pass filter LPF is set so that the MTF 
(Modulation Transfer Function) of the image- format ion lens 
approaches zero at the Nyquist frequency vn. This 
substantially achieves that purpose. 
25 A"") T^eanwhile, in the case of the optical low-pass filter 
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LPF utilizing trie double-refraction characteristic of the 
quartz, the MTFjdoes not always reach zero at the Nyquist 
frequency vn, there is a probability of taking in an 
undesirable hic/h- frequency component at the focus detection. 
However, since/the sampling of the R and G images is in a 
state shifted py half of the pitch and there is a half pitch 
shifting system for the G image as with the relationship 
J3 between the Ri and B images, if the focus detection outputs 

m I 

J3 are obtained fErom the R and B systems and the two G systems 

u? 

nj 10 to be averagep, then it is possible to provide a sufficient 

M, focus detection accuracy. 




la* In addition, in the in-focus state, since a phase error 

C3 



is equally superimposed on a pair of signals, a focus 



q detection error develops even if the aforesaid phenomenon 

■Q 

15 occurs. This means that, even if the average cannot be 

calculated because of only one focus detection output, it is 
possible to secure the final in-focus state. 

Furthermore, according to the optical low-pass filter 
characteristic, one light beam incident on the optical low- 

20 pass filter LPF forming a parallel flat plate is divided 
into two light beams which in turn, are emitted as a 
parallel light beam. When the incident light and the 
emergent light are in parallel with each other, although the 
projection of each light-receiving section to the exit pupil 

25 of the image pickup optical system 24 through the microlens 
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creates a blurred image corresponding to approximately 2P, 
this does not practically produce a problem. 

ncidentally, although an optical low-pass filter of 
the t^pe of one light beam incident thereon being emitted in 
a stat$ diffused has been known, in the case of this type, 
the incident light and the emergent light is not in parallel 
relation\to each other. Accordingly, the projection of each 
light-receiving section to the exit pupil of the image 
pickup optVlcal system 24 through the microlens goes out of 
order, whiqh ruins the function of the focus detection 
system. 

Fig. 15 is a block diagram showing an internal 
arrangement of the image pickup element 100 and peripheral 
circuits. In the image pickup element 100, there are 
provided a timing generating section 101, an area sensor 
section 102, a vertical scanning section 103 and horizontal 
scanning section 104 for selecting the outputs of the pixels, 
an analog signal processing section 105, an A/D conversion 
section 106 for conducting analog/digital conversion, a 
digital signal processing section 107 for converting the 
digitized signal into an output signal, and an interface 
(IF) section 108 for outputting a digital image signal to 
the external and for receiving command data from the 
external . 

In Fig. 15, the area sensor section 102 is the above- 
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mentioned CMOS sensor, and has one source follower type 
source follower amplifier MOS transistor 5 including the 
first and second photoelectric conversion sections shown in 
Fig. 3. 

She timing generating section 101 generates a timing 



lignal for reading out an image signal , photoelectric - 

convertem in each -pixel, on the basis of a master clock with 

■u \ 

■^3 a reference frequency from the external, with the vertical 

y 3 \ 

yO and horizontal scanning sections 103 and 104 perform needed 

f*fi \ 

rU 10 scanning coAtrol in accordance with this timing signal to 

4z 

M* read out the ^electric charge photoelectric-converted in each 

M* pixel. A vertical synchronizing signal and a horizontal 

O \ 

y synchronizing s^ignal are outputted from the timing 

O 

generating section 101 to the external so that synchronizing 



15 signals are suppuied to systems, other than the image pickup 
element, which require timing signals. 

The analog signal processing section 105 is for 
conducting the noise reduction processing, the amplification 
processing, the gamma processing and the clamp processing 

20 with respect to the image signal read out from the area 
sensor section 102 to output the image signal after the 
processing to the A/D conversion section 106. The A/D 
conversion section 106 converts this image signal into a 
digital signal and outputs it, while the digital signal 

2 5 processing section 107 processes the image signal, 
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undergoing the digital conversion in the A/D conversion 
section 106 , with a displayable image signal through the use 
of an image RAM memory or the like and outputs the processed 
image signal to the interface section 108. 

interface section 108 outputs the digital image 
outputted from the distal signal processing section 
107/ to tJie exterior of the image pickup element 100. 

The iniaqe pickup element 100 is controllable in mode, 
output signa\L form, signal output timing and others 
according to a command from the external, and when a 
predetermined cbmmand is given from the external to the 
interface sectiori 108, according to the command the 
interface section \l08 receives, each of components is 
controlled, for example, the vertical and horizontal 
scanning sections 10a and 104 are controlled for the control 
of the readout timing \o the area sensor section for the 
focus detection. 

The image pickup element 100 is designed to be switched 
between a first output mode for making a photoelectric 
conversion output by a light beam from the entire exit pupil 
of the image pickup lens and a second output mode for making 
a photoelectric conversion output by a light beam from a 
portion of the exit pupil of the image pickup lens. 

Furthermore, a description will be given hereinbelow of 
an image output for the focus detection. 
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described above with reference to Figs. 9, 10 and 11 , 
r the fodps detection image is produced in a manner that the 
photoelectric conversion of a pair of object images , formed 
in the second output mode, are performed at substantially 
same timing and an image signal from the first photoelectric 
conversion section and an image signal from the second 
photoelectric^ conversion section are outputted separately 
and independently . 

If an object image projected to a focus detection area 
is in a defocus condition, the phases of the image signals 
are shifted in the pupil division direction. Therefore, if 
the focus detection area is formed into a rectangular 
configuration whose longitudinal direction coincides with 
the division direction of the pupil of the image pickup 
optical system, the phase shift quantity is detected using a 
long continuous image signal, which increase the precision 
of the shift quantity detection. 

For easily obtaining the focus detection image, an 
output position designation command is prepared as one of 
the commands of the digital signal processing section 107 
described above. The output position designation commands 
are indicated as signal processing 107e, in Fig. 16 and 
designate any one of the vertically elongated rectangular 
focus detection areas 61 to 67 shown in Fig. 4 or a 
combination thereof. Additionally, it is also appropriate 



that the selection of a predetermined focus detection 
area(s) is not made but a pointing device such as a track 
ball is prepared to output a designation to a CPU included 
in an operation control section so that the CPU control 
function arbitrarily designates some of focus detection 
areas which are approximately several hundreds in number. 

The line including the designated specific area is 
designed to output a focus detection image in a state where 
the electric charge storage level is optimized. For 
obtaining an appropriate signal level in the focus detection 
area, the diaphragm closing shown in Fig. 2 and the 
electronic shutter setting are formed according to focus 
detection area. In the CCD type image pickup element, the 
electric charge accumulating times of all the pixels are the 
same, whereas, by making use of the feature of the CMOS 
sensor, the image pickup element 100 can easily employ a 
structure to perform the readout in units of pixels, lines 
or blocks, and allows the start and end of the accumulating 
(storage) time to be different according to unit. In this 
case, the electric storage time is changed in units of 
vertical lines so that the image in the focus detection area 
can effectively use the A/D conversion range. 

Referring to Figs. 17A to 17D, a description will be 
given hereinbelow of an electronic shutter function. In a 
case in which the pixels are read out in vertical line 



sequence as shown in Fig. 17A, as Fig. 17B shows , the 
invalid electric charge stored in the pixels in the first 
line is reset at the pixel reset indicated by an upward 
arrow, before the effective accumulating operation starts. 
The pixel is read at the pixel readout indicated by a 
downward arrow after the elapse of a predetermined period of 
time indicated by oblique lines , and the image signal is 
given to the next-stage signal processing section. 
Furthermore, the second, third, lines are scanned 
likewise. In the effective accumulating operation, 
different timings are used according to vertical line, but 
the accumulating times are substantially equal to each other 

With respect to the entire image plane, in the case of 
shortening the electric charge accumulating time, as shown 
in Fig. 17C, the pixel reset timing for resetting the 
invalid electric charge is shifted backwardly in time, 
thereby shortening the effective accumulating operation time 
and conducting the electronic shutter operation. This 
operation switches the mode of the timing generating section 
101 according to an electronic shutter command received by 
the interface section 108. 

In addition, the setting of the effective accumulating 
operation time in units of vertical lines is conducted as 
shown in Fig. 17D. Fig. 17D shows an example in which, 
assuming that the focus detection area exists on the second 
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line, the effective accumulating time is set to be different 
from those of the other lines for appropriately setting the 
signal level in the second line* 

The focus detection images thus obtained are a pair of 
images formed by the halves of a light beam in the second 
output mode as mentioned above/ and although the 
accumulating time differs from those of the other lines , 
these are added on the signal processing and multiplied by a 
gain which eliminates the difference between the 
accumulating times , thus easily producing information 
identical in condition to those of the other lines . 
Accordingly, in a case in which an image picked up is 
displayed on a monitor , such processing is conducted for 
obtaining information on the entire image plane while 
performing the focus detection. 

Returning to Figs. 5 and 3, a detailed description will 
be given hereinbelow of the electric charge accumulating 
operation. 

>irst, a positive voltage is applied to a control 
fulsesxbPGoo (odd lines) and <J»PGeo (even lines) for 
enlargingr the depletion layers under the photogates 2 and 52 
During the\ accumulation, the FD section 21 sets the control 
pulse <j>Ro at\a high state to fix it to a voltage V DD for 
preventing the, blooming. When carriers occur under the 
photogates 2 ana, 52 due to the irradiation of photon hv, 
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electron is accumulated in the depletion layers under the 



photogates 2 and 52 , 
through a P-type wel 



the scanning of the 
electric charge accu 



25 



and the positive hole is discharged 
17. 

An energy barrier owing to the transfer MOSS transistor 
is formed between tlie photoelectric conversion section 1 and 
the FD section 21 f vhile an energy barrier due to the 
transfer MOS transistor 53 is formed between the 
photoelectric conversion section 51 and FD section 21. Thus, 
during the photoelectric charge accumulation, the electron 
exists under the photogates 2 and 52. Thereafter, through 

horizontal scanning section 16, the 
mlating operation is similarly 
conducted with respect to the photoelectric conversion 
section 1 and the photoelectric conversion section 51 on the 
other lines, thus accomplishing the accumulation of the 
electric charge in all the photoelectric conversion sections. 

In a readout condition, the control pulses <|>PGoo and 
<|>PGeo and control pu'ses <j>TXoo and <J>TXeo are set so that the 
barrier by the transfer MOS transistor 3 or 53 is removed 
and the electron under the photogate 2 or 52 is completely 
transferred to the FE| section 21. 
(Second Output Mode Operation) 

Referring to the timing chart of Fig. 18, a description 
will be given hereinbelow of an image pickup element readout 
operation. This timing chart shows the case of the second 



output mode for performing two photoelectric conversion 
section outputs independently, and is for reading out the 
focus detection image. 

First, the control pulse <|>L is set to a high state by 
the timing output from the horizontal scanning section 16 to 
lower the horizontal output line to a reference electric 
potential point Vss for resetting it. Additionally, the 
control pulses $Ro, <f>PGoo and <|>PGoo are set to a high state 
to turn on the reset MOS transistor 4, and the first layer 
poly-Si 19 of the photogate 2 is set to a high state. 

At the time T 0 , a control pulse <j>So is set to a high 
state to turn on the selection switch MOS transistor 6 for 
selecting the light-receiving section 30-11. Following this, 
the control pulse <|>Ro is set to a low state to stop the 
reset of the FD area 21, and the FD area 21 is set into a 
floating condition and the through-condition is made between 
the gate and source of the source follower amplifier MOS 
transistor 5, and thereafter, at the time T x , a control pulse 
<|>T N is set to a high level so that the dark voltage of the FD 
area 21 is outputted to the accumulation capacitor C TN 10 
through a source follower operation. 

Subsequently, for making the photoelectric conversion 
output of the first photoelectric conversion section, the 
control pulse <|>TXoo is set to a high level to establish a 
conducting condition of the transfer switch MOS transistor 3, 
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and at the time T 2 , the control pulse <j)PGoo is set to a low 
level. At this time, it is preferable to establish a 
voltage relationship in which the potential well enlarging 
under the photogate 2 rises to completely transfer the 
optical generation carrier to the FD area 21. 

When the electric charge from the photoelectric 
conversion section 1 of the photodiode is transferred to the 
FD area 21 at the time T 2 , the electric potential of the FD 
area 21 varies according to light. At this time, since the 
source follower amplifier MOS transistor 5 is in the 
floating condition, at the time T 3 , the electric potential of 
the FD area 21 is outputted to the accumulation capacitor C TS 
11 with the control pulse <|>Ts being set to a high level. At 
this point of time, the light output and dark output of the 
first photoelectric conversion section are stored in the 
accumulation capacitors C TN 10 and C TS 11, and a control pulse 
<f>Hc at the time T 4 is temporarily set to a high state to 
establish the conduction states of the vertical output line 
reset MOS transistors 13 and 55 for resetting the vertical 
output line, and in the vertical transfer period, according 
to a scanning timing signal of the vertical scanning section 
15, the MOS switches 12 and 54 are turned on to supply the 
pixel dark output and the optical light output to the 
vertical signal line. When the outputs of the accumulation 
capacitors C TN 10 and C TS 11 are fed to the differential 



m 
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amplifier 14 to obtain a differential output V OUT/ the pixel 
random noise and the fixed pattern noise are removed, thus 
providing an image signal with a high S/N ratio. 

The photoelectric charge of the light-receiving section 
30-12 is stored in the accumulation capacitors C TN 10 and C TS 
11 concurrently with those of the light-receiving section 
30-11, and the read out thereof is made in a state where the 
timing pulse from the vertical scanning section 15 is 

tjQ delayed a quantity corresponding to one light-receiving 

03 

iy 10 section. They are read out to the vertical output line and 

^ are outputted from the differential amplifier 14. When this 

J\ scanning is repeated , it is possible to obtain image signals 

Q 

s , according to the corresponding photoelectric conversion 

2 sections at different times in the time series. Because of 

1=3 

^=3 15 the timing pulse difference corresponding to one light- 
receiving section , it can be considered that both the 
accumulation times are the same. 

Furthermore, after the light output is sent to the 
accumulation capacitor C TS 11, the control pulse <J>Ro is set 
2 0 to a high state to establish the conducting condition of the 
reset MOS transistor 4 for resetting the FD area 21 to the 
power supply V DD . 

After the vertical transfer of the first photoelectric 
conversion comes to an end, the readout of the second 
2 5 photoelectric conversion section is conducted. For the 
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readout of the second photoelectric conversion section, the 
control pulse <|>Ro is set to a low state to stop the reset of 
the FD area 21 and the FD area 21 is set into the floating 
condition and the through-condition is set up between the 
5 gate and source of the source follower amplifier MOS 

transistor 5, and at the time T 5 , the control pulse 4>T N is 
_ set to a high state and the dark voltage of the FD area 21 

a 

CI is outputted to the accumulation capacitor C TN 10 in the 

Ql 

J3 source follower operation. 

S3 

TU 10 For the photoelectric conversion output of the second 

photoelectric conversion section, the control pulse <j>TXeo is 

£ 

m set to a high state to establish the conducting condition of 

yj the transfer switch MOS transistor 53 , and at the time T 6/ 

O 

g the control pulse <|>PGeo is set to a low state. 

~ 15 At the time T 6 , the electric charge from the 

photoelectric conversion section 2 of the photodiode is 
transferred to the FD area 21 so that the electric charge in 
the FD area 21 varies according to light. At this time, 
since the source follower amplifier MOS transistor 5 is in 
20 the floating condition, at the time T 7 , the electric charge 
of the FD area 21 is outputted to the accumulation capacitor 
C TS 11 with the control pulse <j>Ts being set to a high state. 
At this point of time, the light output and dark output of 
the second photoelectric conversion section are stored in 
25 the accumulation capacitors C TN 10 and C TS 11, respectively, 



and at the time T 8/ the control pulse <|>Hc is temporarily set 
to a high state to set up the conducting conditions of the 
vertical output line reset MOS transistors 13 and 55 for 
resetting the vertical output lines , and in the vertical 
transfer period, the pixel dark output and light output are 
fed to the vertical output line according to the scanning 
timing signal of the vertical scanning section 15. At this 
time, a differential output V OUT is obtained from the 
accumulation capacitors C TN 10 and C TS 11 by means of the 
differential amplifier 14. 

With the above-mentioned operations, the readout of the 
first and second photoelectric conversion sections can be 
made independently of each other. 

Thereafter, the scanning of the horizontal scanning 
section 16 is conducted to perform the readout operation 
similarly, thus providing an independent output of the 
entire photoelectric conversion section corresponding to one 
frame. That is, the control pulse <|> s i is first set to a high 
state and then the control pulse is set to a low state, 
and further the control pulses <|>T N and <t>TX 01 are set to a high 
state, the control pulse <(>PG 01 is set to a low state, the 
control pulse <|>Ts is set to a high state, and the control 
pulse <|>Hc is temporarily set to a high state, thereby 
reading out the signals of the first photoelectric 
conversion sections of the light-receiving sections 30-21 



and 30-22. Subsequently, the control pulses ^TXe! and ^PGe! 
are applied and the other control pulses are applied as 
mentioned above , thereby reading out the signals of the 
second photoelectric conversion sections of the light- 
receiving sections 3 0-21 and 30-2 2. 
^ ✓ "^ecause one source follower is not provided in each of 
:7 t#e twb photoelectric conversion sections in one pixels but 
is provided for two photoelectric conversion sections, it is 
possibleVbo halve the source follower amplifier MOS 
transistors 5, the selection switch MOS transistors 6 and 
the reset MOS transistors 4 as compared with the 
conventional art. Accordingly, the open area ratio of the 
photoelectric\conversion section in the pixel is improvable 
and the fining Yi-S realizable by the integration of the 
pixels, which e^rtremely facilitates the use for the focus 
detection. Additionally, since the FD area 21 is used in 
common for two photoelectric conversion sections, there is 
no need to increase uhe capacity of the gate section of the 
source follower amplifier MOS transistor 5, thereby 
preventing a drop of tnte sensitivity. 
(First Output Mode Operation) 

Secondly, a description will be given hereinbelow of a 
first output mode in which the signals of the first and 
second photoelectric conversion sections are added in the FD 
area 21 to output a signal based on a light beam from the 



entire pupil of an objective lens. This operating mode is 
equivalent to an image output in a common image pickup 
element . 

Fig. 17 is a timing chart in a case of adding the 
signals of the first and second photoelectric conversion 
sections. Although, in the non-adding mode shown in Fig. 18, 
the timings of the control pulse <j>TXoo, the control pulse 
4>TXeo, the control pulse <j»PGoo and the control pulse <|>PGeo 
are in shifted conditions, the same timing is taken in the 
case of the addition in this first output mode. That is, 
for simultaneously performing the readout from the first 
photoelectric conversion section and the second 
photoelectric conversion section of the light-receiving 
section 30-11, the control pulse 4>T N is set to a high state 
to read out a noise component from the horizontal output 
line, and then the control pulses <f»TXoo and <|>TXeo and the 
control pulses <|>PGoo and <|>PGeo are simultaneously set to the 
high and low states in transferring to the FD area 21. This 
enables the signals of the two upper and lower photoelectric 
conversion sections to be added in the FD area 21. Because 
of the signal addition at the pixel level, an image with a 
high S/N ratio, which is not obtainable by the addition 
after the signal readout, is attainable without receiving 
the influence of the amplifier noise. 

v ^y^As described above, with to the readout according to 



the timings shown in Fig. 18 , 
focus detection on the image 



the focus detection image for 
pickup lens can be outputted, 



while according to the timincs shown in Fig. 19 , the common 
image based on the entire licht beam can be outputted. That 



is, it is possible to accompl 



the image pickup lens and the 
the photoelectric conversion 



ish the switching between the 



first output mode in which the photoelectric conversion 
output is made by a light beam from the entire exit pupil of 



second output mode in which 
Dutput is made by a light beam 



from a portion of the exit pupil of the image pickup lens . 

According to the first output mode, because the image 
is not blurred unnaturally, it is possible to produce a 
high-quantity image excellent in S/N ratio at the same level 
as that of an image to be originally produced by an image 
pickup element which is designed to offer an image based on 
the entire light beam passing through the pupil of an image 
pickup optical system. 
(Focus Detection Signal Processing) 

A description will be given hereinbelow of signal 
processing for the focus detection. Fig. 20 is an enlarged 
view showing the focus detection area 61 shown in Fig. 4. 
The other focus detection areas 62, 63, 64, 65, 66 and 67 
also have the same structure. Figs. 21 to 28 are graphic 
illustrations of detection characteristics, and show digital 
image signals outputted from the interface section 108 
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mentioned above with reference to Fig. 15. 

^s Fig. 2 0 shows, the focus detection area 61 has two 
pixel columns each comprising twelve light-receiving 
:±onS. the pixel column 82 is composed of the light- 
receiving sections 80-1 , 80-2, — , 80-12, while the pixel 
column 83\ is composed of the light-receiving sections 81-1, 
81-2, ^1-12. Since the color filters of the area sensor 
section lOfi are arranged to form a Bayer pattern, two kinds 
of color filters are alternately arranged in each of the 
pixel columns 82 and 83. Thus, for the focus detection, the 
pixel columns 82 and 83 are classified according to the kind 
of the color \ filter, and a pair of image signals, being the 
signal from tttie first photoelectric conversion section and 
the signal frqm the second photoelectric conversion section, 
are produced therefrom. Accordingly, the image signals Gl , 
G2, Rl and R2 due to the pixel column 82 and the image 
signals Gl, G2 , E\l and B2 due to the pixel column 83, i.e., 
four pairs of ima&e signals in total, are obtainable from 
the focus detection area 61. Incidentally, as mentioned 
above, the accumulating time is substantially taken evenly 
in one focus detection area. 

Figs. 21 to 24 illustrate these four pairs of image 
signals . 

Fig. 21 shows image signals from the light-receiving 
sections 80-1, 80-3, 80-11 equipped with a green color 
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filter in the pixel column 82, where numeral 84 denotes a 
signal of the first photoelectric conversion section 
indicated by Gl, while numeral 85 depicts a signal of the 
second photoelectric conversion section indicated by G2. 
5 Fig, 22 shows image signals from the light-receiving 

sections 81-2 , 81-4 , 81-12 equipped with a green color 
filter in the pixel column 83, where numeral 86 denotes a 

03 signal of the first photoelectric conversion section 

m 

tp indicated by Gl, while numeral 87 depicts a signal of the 

00 

pi 10 second photoelectric conversion section indicated by G2. 
jtS^'JNiS r V- g * 23 show image signals from the light-receiving 
§ctionfc 80-2, 80-4, •*•, 80-12 equipped with a red color 
filter ii\the pixel column 82, where numeral 88 denotes a 
signal of wie first photoelectric conversion section 
15 indicated by\Rl, while numeral 89 depicts a signal of the 
second photoelectric conversion section indicated by R2. 

Fig* 24 shows image signals from the light-receiving 
sections 81-1, 81-3, — , 81-11 equipped with a blue color 
filter in the pixel column 83, where numeral 90 denotes a 
20 signal of the first photoelectric conversion section 

indicated by Bl while numeral 91 depicts a signal of the 
second photoelectric conversion section indicated by B2. 

These are examples in which an object image formed on 
the focus detection area 61 by the image pickup optical 
25 system 24 has a density-varying image of an orange color and 



a yellow color. In Figs. 21 and 22 , the contrast of green 
is high, and in Fig. 23 , the contrast of red is low and the 
intensity thereof is high. Furthermore, in Fig. 24, both 
the contrast and intensity of blue are low. The 
illustrations show a defocus state of an object image, and 
as indicated by arrows A and B, it is seen that the signal 
of the first photoelectric conversion section and the signal 
of the second photoelectric conversion section are shifted 
in phase from each other. 

Furthermore, Figs. 2 5 to 28 show signals in a state 
where the focus is placed on an object image, each of which 
varies with the movement of the second group grp2 of the 
image pickup optical system 24. 

Fig. 25 shows image signals from the light-receiving 
sections 80-1, 80-3, 80-11 equipped with a green filter 
in the pixel column 82, where numeral 184 denotes a signal 
of the first photoelectric conversion section indicated by 
Gl while numeral 185 depicts a signal of the second 
photoelectric conversion signal indicated by G2 . 

Fig. 26 shows image signals from the light-receiving 
sections 81-2, 81-4, 81-12 equipped with a green filter 
in the pixel column 83, where numeral 186 denotes a signal 
of the first photoelectric conversion section indicated by 
Gl while numeral 187 depicts a signal of the second 
photoelectric conversion signal indicated by G2 . 
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Fig. 27 shows image signals from the light-receiving 
sections 80-2 , 80-4 , — , 80-12 equipped with a red filter in 
the pixel column 82, where numeral 188 denotes a signal of 
the first photoelectric conversion section indicated by Rl 
5 while numeral 189 depicts a signal of the second 
photoelectric conversion signal indicated by R2 . 

Fig. 28 shows image signals from the light-receiving 

Q 

*0 sections 81-1 , 81-3, — , 81-11 equipped with a blue filter in 

J3 the pixel column 83, where numeral 190 denotes a signal of 

■CO 

ry 10 the first photoelectric conversion section indicated by Bl 

^ while numeral 191 depicts a signal of the second 

^ photoelectric conversion signal indicated by B2 . 

O 

In a state where the focus is placed on an object, the 

P 

~ signals of the first and second photoelectric conversion 

™ 15 sections agree in phase with each other. Accordingly, the 

in-focus detection is feasible by a decision on the identity 
of a pair of signals. Additionally, by detecting the phase 
shift quantity according to a well-known method (for example, 
Japanese Patent Publication No. 5-88445) using the 
20 correlation operation, it is possible to obtain the defocus 
quantity. 

A description will be given hereinbelow of a signal 
processing method for two images undergoing a photoelectric 
conversion. In the foregoing correlation operation, for 
25 example, when each of the numbers of photoelectric 
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conversion elements of the first and second photoelectric 
conversion sections is taken to be N and the outputs of the 
photoelectric conversion elements are respectively taken as 
a(i) and b(i) (i = 1 to N), the cross correlation V(m) is 
5 given as follows . 

V(m) = 2 (|a(i) - b(i+l-m)| - |(a(i+l) - b(i-m)| ... (1) 

3 

01 

yQ When the shifting quantity between the two images is 

'03 ' 

fy 10 small , that is, when they coincide with each other, the 
i\ correlation V(m) assumes a minimum value. 

J\ Furthermore, it is also appropriate to obtain the 

Cl 

r; correlation V(m) in accordance with the following equation. 

S 
Q 

Q 15 V(m) = 2 (|a(i) - b(i+l-m)| p - |(a(i+l) - b(i-m)| p ... (2) 

where P represents a constant being a positive number. 

In addition, when min(x, y) or max(x, y) are taken as a 
small one or large one of two real numbers x and y, the 
20 correlation V(m) can also be calculated according to the 
following equations . 

V(m) = 2 [min {(a(i), b(i+l-m)> - min {a(i+l), b(i-m)}] 

(3) 

25 V(m) = 2 [max {(a(i), b(i+l-m)} - max {a(i+l), b(i-m)}] 



Through the use of these calculations , it is possible 
to detect the phase shifting quantity and to detect the 
image- format ion state of the image- format ion lens. 

Subsequently , the defocus quantity is obtained and the 
obtained defocus quantity is converted into a quantity by 
which the second group grp2 of the image -format ion optical 
system 24 is to be driven , thereby conducting the automatic 
focusing. Since the driving quantity of the lens can be 
known in advance, the in-focus position is commonly 
achievable by almost one-time lens driving so that the 
focusing is realizable at an extremely high speed. 

Furthermore, although the signals color-separated have 
been used in this case, since the non-color-separation is 
equivalent to the acquisition of the signal obtained by 
adding these signals, a low contrast tends to occur; in 
consequence, the detection- impossible condition easily 
occurs. On the other hand, if the signals color-separated 
are put to use, although a high contrast does not always 
appear in all the R, G and B signals as mentioned above, a 
high contrast is conversely obtainable in any one of the R, 
G and B signals and the focus detection becomes almost 
always possible. 

Incidentally, although an object image passing through 
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the optical low-pass filter LPF is incident on the image 
pickup element 100, because of the characteristics of the 
optical system, high-frequency components higher than the 
Nyquist frequency vn = 1/(2 x 2P) of the focus detection 
system are not without being introduced. Accordingly, 
depending upon the pattern of an object, the phase of the 
object image does not reflect the phase of a signal and the 
focus detection result may include somewhat of an error. 

In the case of no image phase difference, since an 
phase error is evenly introduced into a pair of signals, 
even if this phenomenon occurs, no focus detection error 
occurs. That is, in the case of the signals shown in Figs. 
25 and 26, an error does not occur at the in-focus decision, 
but in the case of the signals shown in Figs. 21 and 22, an 
error occurs at the defocus quantity detection. 

However, this defocus quantity detection error does not 
create a problem, because, as seen from Figs. 20 to 22, the 
signals 86 and 87 are shifted by half of the pitch in 
sampling position of the object image with respect to the 
signals 84 and 85 and, if the focus detection result 
calculated on the basis of the signals 84 and 85 and the 
focus detection result obtained on the basis of the signals 
86 and 87 are averaged to obtain the final focus detection 
result, the focus detection error is reducible. 

Likewise, since the signals 90 and 91 are shifted by 
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half of the pitch in sampling position with respect to the 
signals 88 and 89 , the focus detection error is reducible by 
averaging the focus detection result calculated on the basis 
of the signals 88 and 89 and the focus detection result 
calculated on the basis of the signals 90 and 91 for 
obtaining the final focus detection result. In this case, 
the averaging of the focus detection results is made with 
respect to red and blue, and in consequence, the chromatic 
aberrations of the image pickup optical system 24 are 
averaged; therefore, this is preferable. 

Furthermore, if only high-reliability focus detection 
results are selected from the focus detection result 
calculated from the signals 84 and 85, the focus detection 
result calculated from the signals 86 and 87, the focus 
detection result calculated from the signals 88 and 89 and 
the focus detection result calculated from the signals 90 
and 91 and averaged, a higher focus detection accuracy is 
attainable. For example, in the case of a low-contrast 
signal shown in Fig. 23 or 24, the focus detection result 
calculated therefrom may not be used for the focusing. 
(Defocus Handling Processing) 

The above description has been given assuming that the 
signal of the first photoelectric conversion section and the 
signal of the second photoelectric conversion section have a 
relationship in which only their phases are shifted from 
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each other. However, this assumption is satisfied in a case 

in which the defocus quantity is relatively small. Secondly , 

a description will be given hereinbelow of a way of dealing 

with large focus situations. 

5 In the image pickup unit shown in Fig. 2, the diaphragm 

ST has five openings (apertures) 204 to 208. The openings 

204, 205 and 206 are for image pickup, while the openings 

u3 207 and 208 are for large-def ocus detection. At the image 

01 

43 pickup, one of the openings 204 to 206 is automatically 

Ms? 

jnj 10 selected according to the luminance of an object to be 



imaged. Alternatively, it is also possible that a user 
jL^ arbitrarily selects one of the openings 204 to 206. As the 

2 opening is made smaller, that is, if the opening 205 is 

^ selected instead of the opening 204 or the opening 206 is 

u 15 selected in place of the opening 205, the in- focus range 
becomes deeper on the field side and the time of the 
electric charge accumulation by the electronic shutter is 
prolonged. 

Each of the microlenses placed on the image pickup 
20 element projects each of the light-receiving sections of the 
image pickup element 100 to the exit pupil of the image 
pickup optical system 24, and for establishing a linear 
relationship between the light quantity incident on each 
light-receiving section of the image pickup element 100 and 
25 the opening of the diaphragm ST, the power is set so that 
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the projected image of each light-receiving section becomes 
larger than the exit pupil of the image pickup optical 
system 24 at the release of the diaphragm ST. That is, when 
the light-receiving section projected image and the opening 
are compared with each other on the diaphragm ST, the light - 
receiving section projected image is larger than the largest 
opening 204. In this way, the incident light quantity on 
the image pickup element 100 becomes approximately 
tfj proportional to the opening area of the diaphragm ST, and 

knowing the subject luminance and the sensitivity of the 
image pickup element 100, the diaphragm opening degree and 
the shutter speed are calculable in the same manner as that 
for a film camera. That is, the incident light quantity 
becomes proportional to the diaphragm opening area to 
satisfy the calculation according to the APEX mode. 

As described above with reference to Fig. 12, when the 
image pickup is made using any one of the openings 204, 205 
and 206, the image formed is based on half of a light beam 
in a state where a circle is divided into two sections. In 
20 general, an object image is given by a combination of point 
images and luminance patterns of the object, and when the 
defocus quantity of the object image increases, the form of 
the exit pupil appears on the point images. In consequence, 
a blurred state appears on the image in the form of the 
25 division of a circle into two sections. 
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SMS w^jen the formation of a pair of focus detection images 
!.s made\through a pair of exit pupils which overlap by 
parallel movement, irrespective of the configuration of 
individual V>upils , the signals of the first and second 
photoelectrijc conversion sections shows a relationship in 
which only their phases are shifted from each other. 
However, as FiA. 12 shows, in the case of this image pickup 
unit, the conf igVrations of the first area 211 and the 
second area 212 oi\ the exit pupil are in reversed relation 
to each other, and fcliey do not overlap by the parallel 
movement. Accordingly^ the blurs to be superimposed on the 
image similarly result Vn reversed relation to each other; 
hence, the signals of the, first and second photoelectric 
conversion sections develob a state in which their phases 
shift from each other while Vheir configurations vary. At a 
large-defocus condition, the image phase difference 
detection becomes difficult, thereby creating a large- 
defocus quantity detection error. 

In addition, as another factor to increase the defocus 
quantity detection error in a large-defocus condition, there 
is an error stemming from manufacturing of microlenses . As 
mentioned above, the microlens projects a light-receiving 
section to the exit pupil of an image pickup optical system. 
If the projection position varies according to pixel, then 
the phase shift quantity assumes a different value according 
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to pixel. This effect becomes more serious as the defocus 
quantity increases. However, the microlens has a very fine 
structure; therefore , in fact, the difference among the 
microlenses stemming from the manufacturing may be 
i compromised to some degree. 

Accordingly, for a large focus detection, the large- 
defocus detection openings 207 and 208 of the diaphragm ST 
are put to use. In this case, the state of the division of 
*0 the exit pupil is as shown in Fig. 29. In Fig. 29, numerals 

fy 10 213 and 214 denote virtual images of the diaphragm openings 
jy, 207 and 208 viewed through the rear lens group 2 02, and 

signify a third area and a fourth area formed on the exit 
pupil by the openings 207 and 208. 

The third area 213 is included in the first area 211 
15 and the fourth area 214 is included in the second area 212, 
and therefore, the openings 207 and 208 determine the 
configuration of the exit pupil. A light beam passing 
through the opening 2 07 is incident on the first 
photoelectric conversion section while a light beam passing 
20 through the opening 2 08 is incident on the second 
photoelectric conversion section. 

Although the first area 211 and the second area 212 
receive the influence of the accuracy of the pupil 
projection by the microlens, the third area 213 and the 
25 fourth area 214 are not affected by the microlens pupil 
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projection accuracy. Accordingly/ even if a microlens 
manufacturing error occurs and even if the positions of the 
first area 211 and the second area 212 vary according to 
pixel , the use of the openings 2 07 and 208 prevents the 
variation to provide the third area 213 and the fourth area 
214 in a fixed condition. 

For example , if the configurations of the openings 207 
and 208 are made to be an ellipse or a circle, since they 
are the same configurations which can overlap with each 
other according to the parallel movement, the signals of the 
first and second photoelectric conversion sections have a 
relationship in which only their phases are fully shifted 
from each other. Additionally, they are not affected by the 
microlens manufacturing error. Accordingly, even if the 
defocus is large, it is possible to suppress the defocus 
quantity detection error to an extremely small value. 
Furthermore, when the incidence heights of the centers of 
gravity of the openings 207 and 208 are set at approximately 
0.7 times the opening diameter of the diaphragm released, it 
is possible to precisely detect the defocus quantity to the 
best resolution in an image pickup optical system having a 
common spherical aberration characteristic at the aberration 
level . 

Incidentally, when the second group grp2 and fourth 
group grp4 of the image pickup optical system 24 are moved 
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in the optical axis direction for zooming , although the 
release F-number varies commonly , since the positional 
relationship in center of gravity between the openings 207 
and 208 with respect to the release opening is maintained at 
a constant ratio, the incidence heights of the centers of 
gravity of the openings 2 07 and 208 preferably become 
approximately 0.7 times the release opening diameter at all 
times regardless of the zoom position. 

In the first focusing operation in which there is a low 
possibility of the focus being placed on an object of the 
subject, the openings 207 and 208 are first used and, even 
in the case of a large defocus, a monitor display for 
focusing and object observation is made to deal with this 
large defocus. In the following focusing operations, 
further focusing and monitor display may be made through the 
use of any one of the openings 204, 205 and 206 and the 
sequence of the image pickup unit may be arranged for the 
subsequent image pickup. 

This image pickup unit does not require a dedicated 
focus detecting device for detecting a defocus quantity of 
the image pickup optical system, and hence, there is no need 
to use a mirror and prism for division of an optical path. 
[Second Embodiment] 

Fig. 3 0 shows an image pickup unit according to a 
second embodiment of the present invention. In the 



illustration, reference mark ST1 represents a first 
diaphragm and reference mark ST2 designates a second 
diaphragm rotatable coaxially with the first diaphragm STl. 
The first diaphragm STl excludes the large-def ocus detection 
openings 207 and 208 from the diaphragm ST according to the 
first embodiment shown in Fig. 28. The first and second 
diaphragms STl and ST2 are disposed in a state adjacent to 
each other. The first and second diaphragms STl and ST2 are 
driven by a motor (not shown) to take three or four 
positions . 

In Fig. 30 , numeral 2 01 designates, of an image pickup 
optical system 24, a front lens group collectively 
representing a first group (grpl) and a second group (grp2) 
existing on the object side with respect to the diaphragms 
STl and ST2, numeral 202 represents, of the image pickup 
optical system 24, a rear lens group collectively 
representing a third group (grp3), a fourth group (grp4) and 
an optical low-pass filter LPF existing on the image plane 
side with respect to the diaphragms STl and ST2, with light 
beams passing through the openings of the diaphragms STl and 
ST2 forming an object image on an image pickup element 100. 
The diaphragms STl and ST2 are individually rotatable around 
the axis L2, and selectively take three or four positions 
existing at an interval of a predetermined angle by means of 
a driving force of the motor (not shown). 



e second diaphragm ST2 has seven openings designated 
reference numerals J220 to 227 , with the opening 227 being 
for image pickup while the openings 220 and 221 , the 
openings 222 and 223,/ and the openings 224 and 225 being 
paired for large-defocus detection. The opening 227 is used 
when a light beam is/ limited with the first diaphragm STl , 
and at the image piakup, concurrently with the setting of 
the opening 227 of the second diaphragm ST2, one of the 
openings of the firfst diaphragm STl is automatically 
selected according/ to the luminance of the object to be 
imaged. Alternatively , a user can arbitrarily select one of 
them. 

Each of micr<blens provided on the image pickup element 
100 projects each light-receiving section of the image 
pickup element 100 to an exit pupil of the image pickup 
optical system, and for establishing a linear relationship 

quantity incident on each light-receiving 
e pickup element 100 and the opening 
degree of the first diaphragm STl, the power thereof is set 
so that the projected image of each light-receiving section 
becomes larger than! the exit pupil of the image pickup 
optical system 24 ak the release of the first diaphragm STl. 
That is, when the lilght-receiving section projected image 
and the opening are compared with each other on the 
diaphragm STl, the light-receiving section projected image 



between the light 
section of the ima 



is larger than the largest 



opening of the first diaphragm 



STl. In this way, the incident light quantity on the image 
pickup element 100 becomes approximately proportional to the 
diaphragm opening area, arid knowing the subject luminance 
and the sensitivity of the image pickup element 100, the 
diaphragm opening degree and the shutter speed are 
calculable in the same manner as that for a film camera. 
That is, the incident light quantity becomes proportional to 
the diaphragm opening area to satisfy the calculation 
according to the APEX modfe. 

At the large-defocus detection, there are used any one 
of sets of openings 220 and 221, 222 and 223, 224 and 225 of 
the second diaphragms ST2 and the largest opening of the 
first diaphragm STl for ensuring that the light beam depends 
upon the opening of the second diaphragm ST2 . 

When the openings 220 and 221 are used, the state of 
division of the exit pupil becomes as shown in Fig. 30 in 
the case of the first embodiment. As mentioned above, in 
the illustration, numerals 213 and 214 represent virtual 
images of second diaphragm openings 220 and 221, in place of 
the diaphragm openings 207 and 2 08, viewed through the rear 
lens group 202, and signify a third area and a fourth area, 
formed on the exit pupil by means of the openings 220 and 
221. 

The third area 213 is included in the first area 220 
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while the fourth area 214 is included in the second area 221, 
Therefore , the openings 22 0 and 221 determine the 
configuration of the exit pupil. A light beam passing 
through the opening 220 is incident on the first 
5 photoelectric conversion while a light beam passing through 
the opening 221 is incident on the second photoelectric 
conversion section. 

.fcjp Although the first area 220 and the second area 221 is 

CH 

yg affected by the accuracy of the pupil projection by the 

■Q3 

m 10 microlens, the third area 213 and the fourth area 214 is not 
y, affected by the accuracy of the pupil projection by the 

^ microlens. Accordingly , even if a microlens manufacturing 

|tJ error occurs and even if the positions of the first area 220 

^ and the second area 221 vary according to pixel, the use of 

15 the openings 220 and 221 can provide the third area 213 and 
the fourth area 214 in a fixed condition. 

For example, if the configurations of the openings 220 
and 221 are made to be an ellipse or a circle, since they 
are the same configurations which can overlap with each 
2 0 other according to the parallel movement, the signals of the 
first and second photoelectric conversion sections have a 
relationship in which only their phases are fully shifted 
from each other. Additionally, they are not affected by the 
microlens manufacturing error. Accordingly, even if the 
25 defocus is large, it is possible to suppress the defocus 
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quantity detection error to an extremely small value. 

As mentioned above , the use of the openings 220 and 221 
enables the large-def ocus detection. Meanwhile , in general , 
it is practically convenient that the shortest imaging 
distance D[m] of the taking lens is given by the following 
equation (1) as a function of an imaging field angle 6[°]. 

D = O.2/tan(0/2) (1) 



V&y, tl 



Len the shortest imaging distance is defined in this 



</ay, they drawing-out of the imaging lens is set at the 
/ shortest imaging distance , and the defocus quantity in a 
case in whiqh an object at infinity is captured is 
approximately^ proportional to the square of the focal length 
of the taking Pens, Therefore, in the case of the 
employment of a super telephoto lens in which a taking lens 
has an extremely rbng focal length, or in the case of the 
selection of the zoom telephoto side, an extremely large 
defocus can occur, arm the phase shifting of the signals of 
the first and second photoelectric conversion sections is 
too large, which may causes the common range of the signals 
to disappear. Naturally, if* this case, the phase difference 
detection becomes impossible: 

Fig. 31 is an illustration of a state of division of an 
exit pupil in a case of employment of the openings 222 and 
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223, having a function to reduce the phase shift quantity 
taking place at a unit defocus, for coping with such a 
situation. In Fig. 31, numeral 230 represents an exit pupil 
in a case in which the first diaphragm ST1 is in a released 
5 condition, numeral 231 designates a first area on the exit 
pupil through which an light beam incident on the first 
photoelectric conversion section of the image pickup element 

*C 100 passes, and numeral 232 denotes a second area on the 

y * 

*£) exit pupil through which a light beam incident on the second 

05 

fy 10 photoelectric conversion section of the image pickup element 

■Q, 100 passes. Numerals 233 and 234 signify virtual images of 

^ the diaphragm openings 222 and 223 viewed through the rear 

i;i lens group 202, and denote a third area and a fourth area on 

Q 

p the exit pupil, formed by the openings 222 and 223. 

w 15 The third area 233 is included in the first area 231 

while the fourth area 234 is included in the second area. 
Therefore, the openings 222 and 223 determine the 
configuration of the exit pupil. A light beam passing 
through the opening 222 is incident on the first 
20 photoelectric conversion section while a light beam passing 
through the opening 223 is incident on the second 
photoelectric conversion section. As compared with the 
openings 220 and 221, the third and fourth areas on the exit 
pupil are smaller, and hence, it is possible to decrease the 
25 phase shift quantity occurring at the unit defocus. 
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Additionally, if the openings 224 and 225 are put to use, it 
is possible to further reduce the phase shift quantity 
occurring at the unit def ocus . 

Fig. 32 shows a state of division of an exit pupil in 
5 the case of the openings 224 and 225. In Fig. 32, numerals 
235 and 23 6 designate virtual images of the diaphragm 
openings 224 and 225 in Fig. 30 viewed through the rear lens 
yp group 202, and signify a third area and a fourth area on the 

-v0 exit pupil formed by the openings 224 and 225. 

03 

pj 10 The third area 235 is included in the first area 231 

. ... 

while the fourth area 236 is included in the second area. 
Accordingly, the openings 2 22 and 223 determine the 

Q 

configuration of the exit pupil. A light beam passing 

o 

p through the opening 224 is incident on the first 

^ 15 photoelectric conversion section while a light beam passing 
through the opening 225 is incident on the second 
photoelectric conversion section. 

In the case of the employment of a super telephoto lens, 
or in the case of the selection of the zoom telephoto side, 
20 a control circuit for the focusing or the like first uses 

the openings 224 and 225 at the first focusing operation in 
which the possibility of the in-focus state with respect to 
an object is extremely low, and irrespective of the 
occurrence of an extremely large def ocus, performs a monitor 
25 display for the focusing and the object observation coping 
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with this, and then uses the openings 222 and 223 in the 
second focusing operation, and further uses the openings 220 
and 221 in the third focusing operation. That is, the 
openings to be used are switched successively. 

When the fact of a small defocus quantity becomes clear, 
a sequence in the image pickup unit may be made such that 
the control circuit sets the second diaphragm opening 227 
and, at the same time, selects one of the first diaphragm 
openings according to the luminance of an object to be 
photographed to perform the remaining focusing and monitor 
display, then preparing for the subsequent image pickup. 

As described above, the present invention comprises an 
image- format ion lens, a solid-state image pickup element for 
obtaining a photoelectric conversion output corresponding to 
a light beam from a first area of an exit pupil of the 
image- format ion lens and a photoelectric conversion output 
corresponding to a light beam from a second area thereof, 
light-intercepting means provided in the image-formation 
lens and having a third area included in the first area and 
a fourth area included in the second area for allowing light 
to pass through the third and fourth areas and for 
inhibiting light from passing through other than the third 
and fourth areas, and arithmetic means for detecting an 
image formation state of the image- format ion lens on the 
basis of the photoelectric conversion outputs, and provides 
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the following effects. 

(1) It is possible to provide a phase difference 
detection type focus detecting device for use in an image 
pickup unit which is capable of detecting a large defocus in 
a state where the incident light quantity on the image 
pickup element is made to be approximately proportional to 
the diaphragm opening area. 

(2) It is possible to detect a large defocus while 
accepting a microlens manufacturing error to some degree. 

(3) It is possible to accomplish the size reduction of 
the image pickup system because there is no need to use a 
mirror or a prism for optical path division. 

It should be understood that the foregoing relates to 
only preferred embodiments of the present invention , and 
that it is intended to cover all changes and modifications 
of the embodiments of the invention herein used for the 
purpose of the disclosure, which do not constitute 
departures from the spirit and scope of the invention. 

While the present invention has been described with 
reference to what are presently considered to be the 
preferred embodiments , it is to be understood that the 
invention is not limited to the disclosed embodiments. On 
the contrary , the invention is intended to cover various 
modifications and equivalent arrangements included within 
the spirit and scope of the appended claims . The scope of 
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the following claims is to be accorded the broadest 
interpretation so as to encompass all such modifications and 
equivalent structures and functions. 
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